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METHODS AND SYSTEMS OF OBTAINING CONSUMER REVIEWS 



Background of the Invention 

Field of the Invention 

The present invention is related to systems and methods for obtaining 
information regarding consumer experiences, and more specifically, to methods and 
systems for obtaining consumer reviews of products or services. 



10 Description of the Related Art 

The Internet allows consumers to access a wealth of information concerning 
products or services they are considering purchasing. However, obtaining information 
from one of the most useful sources of information, that is, other consumers, has proven 
very difficult. For example, while many Internet commerce sites allow consumers to 

15 provide their reviews of a given product or service, few consumers actually do so. 

Consumers may intend to provide a review once they have used the product or service, 
but then forget to do so. 

Similarly, merchants and manufacturers typically lack sufficient information 
about consumer experiences with items correspondingly sold by the merchants or made 

20 by the manufacturers. Thus, merchants and manufacturers are deprived of information 

that would allow them to provide better service and/or products. Furthermore, because 
merchants are deprived of sufficient consumer opinions about previously purchased 
items, they are inhibited in their ability to generate an accurate consumer profile that 
would allow the merchants to recommend future items for purchase by the consumer. 

25 Thus, consumers, merchants, and manufacturers are currently deprived from 

adequately benefiting from the experiences of large numbers of prior consumers. The 
present invention seeks to encourage consumers to provide reviews and/or ratings, so 
that other consumers may take these experiences into account when deciding what 
goods or services to purchase and so that merchants and manufactures can provide 

30 consumers with better service and products. 
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Summary of the Invention 
One embodiment of the present invention seeks to encourage consumers to 
provide reviews, so that other consumers may take these experiences into account when 
deciding what goods or services to purchase, or as part of an exchange of ideas and 
opinions. In addition, the reviews may be used by merchants, distributors, and 
manufacturers to improve their service and/or products. In accordance with one 
embodiment of the present invention, a system provides review requests to consumers a 
predetermined amount of time after they make a purchase of an item or service. 

For example, a customer may order an item from an Internet-based merchant 
using an electronic catalog. If the customer orders a book, a review request will be e- 
mailed to the customer or presented to the customer on a Web page a predetermined 
amount of time after the book is purchased or delivered asking the customer for a 
review of the book. The review request may be for a point rating review and/or a 
textual review. The predetermined amount of time may be independent of the length of 
the book or the type of book. Alternatively, the predetermined amount of time may be 
greater for a relatively longer book or for a non-fiction work, as opposed to fictional 
work. For items that take a shorter amount of time to evaluate, such as toys, audio 
disks, and videos, the review request may be sent a correspondingly shorter time, such 
as a week, after the item was purchased. The review request may be sent or presented 
specifically on weekends or hohdays, when people are more likely to have free time to 
provide such reviews. 

In addition, the review request may be triggered by other events that indicate 
that the customer has completed reading the ordered book. For example, if the customer 
orders another book to be dehvered to the customer's address, it may be inferred that the 
customer has completed reading the previous book. 

The customer may provide the review either via a reply e-mail or by chcking on 
or otherwise selecting a link in the review request which will link the customer to a 
form delivered over the Internet. In one embodiment, the merchant or other review 
collector can identify and verify that the review comes from an actual purchaser or user 
of the item being reviewed. This allows the review collector to distinguish reviews 
coming from a credible source, such as an item purchaser, rather than an anonymous or 



unverifiable source which may actually be the item manufacturer, author, a competitor 
or a prankster. 

The reviewer identification may be accomplished using a variety of techniques. 
For example, the link in the review request may be to a unique URL associated with the 
5 customer. Thus, the review collector can be substantially certain that a review provided 
via such a link is an actual customer and a purchaser of the reviewed item. Using 
another technique, if the customer visits the merchant Web site, the merchant can 
examine the order history stored in or in association with the customer's cookie using 
standard cookie techniques, and verify that the customer had actually purchased the 
10 reviewed item. If the customer provides the review via an e-mail, the review collector 

can determine if the review is an actual purchaser of the reviewed item by comparing 
the reviewer's e-mail address with corresponding customer e-mail addresses stored in a 
ill customer database. If a match is found, the customer's order history can be examined to 

n determine if the customer purchased the reviewed item. If the customer had purchased 

Jf 1 5 the reviewed item, then the review collector can have a high degree of confidence that 

4^ the review is a credible review from an actual purchaser and user of the reviewed item, 

fe A reward or incentive may be offered to further encourage the customer to 

provide a review. The reward may be in the form of a rebate on the reviewed item, a 
discount coupon toward the purchase of another item, a free gift, free or discounted gift 
D 20 wrapping and/or shipping, and the like. The reward may be conditioned so that it is 

only available if the customer responds within a certain period of time, or if the review 
meets certain other conditions. 

The reviews, which may include item ratings and/or textual reviews, may be 
used in a variety of ways. For example, the reviews may be presented to other 
25 customers so that they may better evaluate what items to purchase or as part of a forum 

of ideas. Individual reviews may include a notation, such as an icon or text, indicating 
that the review comes from a verified purchaser of the reviewed item. This allows other 
customers to give greater weight to those reviews from actual item purchasers, which 
are likely to be more credible than completely anonymous or unverified reviews. In one 
30 embodiment, only verified reviews will be presented to a customer. Limiting the 
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presentation of to verified reviews may be done in response to a customer command or 
at the option of the merchant. 

Furthermore, the reviews may be synthesized by a merchant into specific 
recommendations to other customers for items, such as particular books. Reviews 

5 provided by a customer may also be used to build a profile for that customer. The 
customer profile may then be used to recommend other items, such as other books, to 
that customer based on the customer's previous readings and/or item ratings. For 
example, a collaborative recommendations algorithm may be used to recommend items 
to users based on the item rating profiles of such users. For newly released items, the 

10 reviews may also be used by the merchant to forecast sales volumes and associated 

inventory needs. 

In addition, the reviews may be used by merchants, distributors and 
manufactures to improve their service and/or products. For example, if consumers 
indicate via the reviews that they are particularly unhappy with the lack of certain 
15 product features or the overall product performance, manufactures can modify their 
products to include the desired features or to improve the overall product performance. 

Brief Description of the Drawings 
Figure 1 illustrates a first exemplary e-mail message requesting a customer to 
provide a review; 

20 Figure 2 illustrates an exemplary Web site form page used accept a customer 

review; 

Figure 3 illustrates an exemplary consumer review provided via e-mail; 

Figure 4 illustrates an exemplary message presented on a Web site requesting a 
customer to provide a review of previously purchased items; 
25 Figure 5 illustrates an exemplary commerce system, including Web components 

for implementing a review request system in accordance with one embodiment of the 
invention and illustrates typical user components for accessing the system; and 

Figure 6 illustrates an exemplary sequence of acts that are performed by the 
review request application illustrated in Figure 5. 

30 



-4- 



Detailed Description of Preferred Embodiments 
Throughout the following description, the term "Web site" is used to refer to a 
user-accessible network site that implements the basic World Wide Web standards for the 
coding and transmission of hypertextual documents. These standards currently include 
5 HTML (the Hypertext Markup Language) and HTTP (the Hypertext Transfer Protocol). It 

should be understood that the term "site" is not intended to imply a single geographic 
location, as a Web or other network site can, for example, include multiple 
geographically-distributed computer systems that are appropriately hnked together. 
Furthermore, while the following description relates to an embodiment utilizing the 
1 0 Intemet and related protocols, other networks and protocols may be used as well. 

The present invention relates to a review collection system that increases the 
number of reviews collected with respect to goods, services, or the like. The reviews 
^Xi may consist of only a point rating (e.g., one to five stars), or may include textual 

reviews as well. Reviews may also be collected for Web sites, sellers, magazines, 
15 authors, directors, and performers. The sellers for which reviews may be obtained 

1^ include on-line merchants, "physical" bricks and mortar merchants, as well as third 

^ " party sellers on a Web site. These third party sellers may be selling items on auction 

Web sites or on Web sites where third parties can sell items at a fixed price, such as on 

0 Amazon's zShops. Thus, using the present invention, consumers, merchants, 

ft I 

C| 20 distributors, and manufacturers are better informed, and a forum for the exchange of 

ideas is provided. In accordance with one embodiment of the invention, the system 
advantageously provides customers, purchasers and the like with requests to provide a 
review for a purchased item or service a predetermined amount of time after the item 
was purchased or delivered. 
25 For example, a user or customer may order an item, such as a book, jfrom an 

Internet-based merchant using an electronic catalog presented on the customer 
computer. Note, that though this example is based on a book purchase, the invention 
may be used to gather reviews for other types of items, such as electronics, cars, 
clothing, movies, plays, 3'"^ party sellers, and so on. After a certain period of time, 
30 which may be based on an estimated time needed to use and/or evaluate the item, such 

as to read the book, a reminder, request, or notice may be presented to the customer 
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asking for a review. The review request may be sent via e-mail and/or may be placed 
on the customer's computer calendar, such as that associated with Microsoft® Outlook 
or with the Palm® Pilot calendar. In addition, the reminder or request may be presented 
to the customer when the customer visits certain web sites, such as a web site associated 
5 with the merchant which sold the item to the customer. In one embodiment, if the item 
was designated as a gift by the customer, the review request will not be sent to the 
customer. Instead, if the gift recipient's e-mail address is available, the review request 
will be sent to the gift recipient. The review request may also be presented to the 
recipient when the recipient visits the merchant Web site, assuming the gift recipient is 
1 0 identifiable via a cookie or the like. 

The predetermined amount of time after which a review request is sent may be 
set to be the same for all items within an item type. For example, the predetermined 

^5 amount of time may be selected to be the same for all books or for all books within a 

selected set of books. Alternatively, the predetermined amount of time may be selected 
15 to be greater for a relatively long book. For example, a review request may be sent one 

£ month after a 200 page novel was ordered or delivered. By contrast, for a 650 page 

novel, the review request may be sent 10 weeks after the novel was ordered or 
dehvered, giving the purchaser more time to read and evaluate the longer book. The 

CI predetermined amount of time may also be related to the number of books purchased in 

p 20 a single order or within a given amount of time. For example, if the customer orders 5 

books, the predetermined amount of time may be 5 times as long a when the customer 
orders 1 book. 

In addition, the predetermined amount of time may be related to the type of book 
being ordered. For example, a scientific work typically takes longer to read than a 

25 novel. Therefore, a review request or reminder may be sent two months after the order 

or delivery of a 200 page scientific book, as compared to one month for a comparable 
length novel. In addition, if there is a holiday or holiday season within a certain amount 
of time after the purchase is made, the predetermined time may be shortened as people 
tend to read more during these holidays. These estimated evaluation times may be 

30 determined via surveys of consumers, such as readers, to more accurately predict the 

typical or average amount of time needed to evaluate an item. The estimate evaluation 
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may also be based on information regarding that particular customer, such as the 
frequency with which the customer has ordered the item type, such as a book, in the 
past. The survey may include information stored in a merchant database that is used to 
statistically track how long it typically has taken for customers to provide reviews after 
5 purchasing an item. 

The review request may be sent to arrive specifically on nights, weekends or 
holidays, when people are more likely to have free time to provide such reviews. In 
addition, the review request may be triggered by other events that indicate that the 
customer has or may have completed reading the ordered book. For example, if the 

10 customer orders another book to be delivered to the customer's address, it may be 

inferred that the customer has completed reading the previous book, and so a review 
request will be provided to the customer. The inference may be strengthened if the 
newly ordered book is by the same author as the previously ordered book, falls within 
the same category as the previously ordered book, and so on. As described above, the 

1 5 review request may be via e-mail or may be provided on the merchant web site after the 

customer has bought the new book. 

In one embodiment, if the customer has previously ordered a new book on the 
average of once a month and/or previously submitted reviews an average of one month 
after ordering a book, then a review request may be sent to the customer one month after 

20 the purchase or delivery of a new book. The customer may optionally be provided with 

the capability to specify via a form or the like when or if the review request should be 
sent to the customer. For example, the customer may specify that a review request 
should always be sent 9 weeks after a purchase is made. In addition, if several review 
request messages are scheduled to be sent within a few days of one another, the review 

25 requests can be aggregated into a single request, such as a single e-mail. 

The customer may provide the review either via an e-mail reply or by activating 
or clicking on a hyperlink in the review request that hnks the customer to one or more 
forms delivered over the Internet. To further encourage customers to provide reviews, a 
reward or incentive may be offered for consumer generated reviews. The reward may 

30 be in the form of a rebate on the reviewed item, a discount coupon toward the purchase 

of another item, points towards the purchase of another item at a reduced or no cost, a 
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free gift, free or discounted gift wrapping and/or shipping, and the like. The reward 
may only be provided if the customer responds within a certain period of time. In 
addition, the review may have to meet certain criteria to be eligible for a reward. For 
example, the review may have to be greater than a first number of words and/or less 
5 than a second number of words. In addition, the inclusion of obscenities or other 

offensive language may make the review ineligible for a reward. 

An important benefit of this process is that it allows merchants, manufacturers, 
or other collectors to obtain a greater number of product reviews, and in turn, to provide 
those reviews to other consumers or to those involved in the manufacture or distribution 

10 of the products. By then allowing other consumers to read the reviews, consumers are 

more Ukely to be attracted to the merchant site, resulting in more sales. In addition, 
because consumers will be better informed about what is being purchased, they are 
more likely to be satisfied, thus reducing the number of expensive returns. Furthermore, 
the reviews may be synthesized by a merchant into specific recommendations for items, 

15 such as particular books. Further, based on the consumer reviews, manufacturers can 

improve their products to better satisfy consumer needs and expectations. For newly 
released items, the reviews may also be used by the merchant to forecast sales volumes 
and associated inventory needs. 

Of course, in one embodiment reviews may also be collected using conventional 

20 techniques. For example, an individual may simply visit the merchant web site, and 

following the directions provided on the web site, enter a review with or without 
identifying the reviewer. 

Reviews provided by a customer may also be used to build or supplement a 
profile for that customer. The customer profile may then be used to recommend other 

25 items, such as other books, to that customer based on the customer's previous readings 

and item ratings. For example, a collaborative recommendations algorithm may be used 
to recommend items to users based on the item rating profiles of such users. 
Collaborative filtering or recommendation systems operate generally by asking each user 
to rate items, such as products or services, the user is familiar with, and then storing the 

30 user ratings within user-specific rating profiles. To identify the items that may be of 
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interest to a particular user, the user's rating profile is correlated with the profiles of other 
users to identify users with similar tastes. 

For example, in the context of online book sales, suppose that a first user dislikes 
title 1, is indifferent about title 2, and likes titles 3 and 4; and that a second user dislikes 
5 title 1 , is indifferent about title 2, likes title 3, and has not yet read title 4. A collaborative 

filtering system might use this information to predict that the second user will like title 4. 
When applied over large databases of user ratings data, this type of analysis can produce 
predictions that are valuable to both users and merchants. 

Thus, the items rating profiles may be generated through a combination of the 

10 methods described herein and other known methods for prompting users to rate items 

(see, for example, U.S. Appl. No. 09/040,171, filed March 17, 1998, which describes 
aspects of Amazon.com' s BookMatcher service and which is hereby incorporated by 
reference in its entirety.) The customer profiles may also be used to otherwise 
personalize web page content. 

15 One embodiment of the incentive system will now be described with reference 

to Figures 1-5. Throughout the following description, reference will be made to various 
implementation-specific details, including, for example, coding conventions, document 
and protocol standards, and forms used for requesting and providing reviews. These 
details are provided in order to fully set forth a preferred embodiment of the invention, and 

20 not to limit the scope of the invention. The scope of the invention is set forth in the 

appended claims. 

For purposes of illustration, the merchant Web site in the disclosed 
implementation is the Web site ofAmazon.com. As is well known in the field of Intemet 
commerce, the Amazon.com site includes fiinctionahty for allowing users to browse and 

25 make online purchases fi-om a catalog of millions of book tities, as well as to purchase 

toys, games, electronics, music, videos, home improvement items, auction items, and the 
like. As described below, the site includes a review collection database that stores reviews 
and information (product codes, order dates, shipping dates, review incentive-types, 
review incentive periods, etc.) about when reminders or requests should be sent to 

30 customers, and optionally, what incentives or rewards will be offered to customers in 
exchange for reviews. In other embodiments, the items available for purchase from the 
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Web site may, for example, include items available for rent and downloadable items such 
as software programs and digital publications. 

Figure 1 illustrates a first exemplary e-mail message requesting a customer to 
provide a review for a purchased item, in this example, a book. The e-mail may be 
5 automatically generated and sent to the customer a selected amount of time after the item 

was purchased. As depicted by Figure 1, the e-mail specifies for which book the review is 
being sought. The e-mail also notes the date on which the book was purchased. In 
addition, the e-mail message optionally specifies one or more rewards for completing a 
review. Links are provided to review guidelines and to sample reviews. In this example, 

10 the user is provided with a review form and/or instructions for providing the review via e- 

mail, and also provides a link to a URL where a review form is provided. Assuming the 
customer has access to the Internet, activating the link will cause the customer's browser 
to present the review form. 

If the customer wishes to respond via e-mail, the customer may copy and fill in the 

15 attached review form and e-mail it back to the originator or other designated recipient. 

The form includes the title of the item to be reviewed, and provides fields for entering a 
numerical rating, such as on a scale of 1-5, a review title, the review itself, the e-mail 
addresses of those who the review should be sent to, the name, if any, that should be 
provided with the review, and the reviewer's geographical location. To make the 

20 review process easier and quicker for customers, and to further encourage customers to 

provide reviews, in one embodiment, the customer may only be required to provide the 
numerical rating review. One or more of the other fields may then be optionally filled 
out by the customer, or may not be provided to the customer at all. 

Figure 2 illustrates an exemplary Web site form page used accept a customer 

25 review. The Web form page may also be automatically generated and presented to the 

customer in response to activating the corresponding link. The form again specifies for 
which item the review is being sought. A first field 204 allows the customer to provide 
a numerical or star rating of the item. A second field 206 allows the customer to 
provide a titie for the review. A third field 208 allows the customer to provide the text 

30 of the review. The review may be limited to a certain number of words, such as 1,000 
words. A fourth field 210 allows the customer to have their name displayed in 
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association with the review or allows the review to be anonymous. A fifth field 212 
allows the customer to specify their geographical location. A sixth field 214 allows the 
customer to specify that their review should be provided via e-mail to one or more e- 
mail addresses. These addresses may be associated with people who may be interested 
5 in the item or the customer's opinion of the item. 

Once the customer has completed the review, the customer may optionally be 
queried as to whether the customer would like to review other books or items the 
customer has previously purchased. By activating the associated link, the customer is 
presented with a list of books or items that the customer has previously purchased, but 
10 has not reviewed. The customer may activate or select links corresponding to the items, 
and in response, is presented with a review form for the item similar to that illustrated in 
Figure 2. 

Figure 3 illustrates a review provided via e-mail using the outhne provided via 
the e-mail of Figure 1. As can be readily seen, the customer can provide the same 

15 information or more as that provided using the form illustrated in Figure 2. For 

example, the customer can provide a numerical rating, a review title, the review itself, 
the e-mail addresses of those who the review should be sent to, the name, if any, that 
should be provided with the review, the reviewer's geographical location, and so on. In 
one embodiment, the customer does not have to use a form, but instead may use natural 

20 language to provide the same type of information. The review may then be parsed by a 
human or a program to extract and order the information provided. 

Figure 4 illustrates an exemplary message presented on a Web site requesting a 
customer to provide a review for previously purchased items after the customer has 
purchased a new, similar item, such as a new book. As previously discussed, it may be 

25 inferred that if a customer is purchasing a new book to be delivered to the customer's 

address, then the customer has finished evaluating one or more previously purchased 
books. The customer may cUck on or otherwise select one or more of the hsted 
previously purchased items and the customer will then be presented with a linked 
review form, such as that illustrated in Figure 2, 

30 In one embodiment, the merchant or other review collector can identify and 

verify that a review comes fi*om an actual purchaser or user of the item being reviewed. 
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This allows the review collector to distinguish reviews coming from a qredible source, 
such as an item purchaser, from those coming from an anonymous or unverifiable 
source, which may actually be the item manufacturer, author, a competitor or a 
prankster. 

5 The reviewer identification may be accomplished using a variety of techniques. 

For example, the link in the review request may be to a unique URL associated with the 
customer. Thus, the review collector can be substantially certain that a review provided 
via such a link is an actual customer and a purchaser of the reviewed item. Using 
another technique, if the customer visits the merchant Web site to enter a review, the 

10 merchant can examine the order history stored in or in association with a cookie stored 

on the customer's computer and verify that the customer had actually purchased the 
reviewed item. If the customer provides the review via an e-mail, the review collector 
can determine if the review is an actual purchaser of the reviewed item by comparing 
the reviewer's e-mail address with corresponding customer e-mail addresses stored in a 

1 5 customer database. If a match is found, the customer's order history can be examined to 
determine if the customer purchased the reviewed item. If the customer had purchased 
the reviewed item, then the review collector can have a high degree of confidence that 
the review is a credible review from an actual purchaser and user of the reviewed item. 
When reviews are presented to other customers, individual reviews may include 

20 an emphasis or notation, such as an icon or text, indicating that the review comes from a 

verified purchaser of the reviewed item. This allows other customers to give greater 
weight to those reviews from actual item purchasers, which are likely to be more 
credible than completely anonymous or unverified reviews. In one embodiment, only 
verified reviews will be presented to a customer. Limiting the presentation to verified 

25 reviews may be done in response to a customer command, such as via a menu selection 

or by activating an appropriate link, or at the option of the merchant. In addition, 
when reviews are presented to customers, the reviews may be prioritized or ranked for 
presentation based at least in part on whether a given review is from a purchaser. Thus, 
for example, reviews from verified purchasers may be emphasized by presenting those 

30 reviews first or at the top of a fisting or reviews. Other reviews, such as those provided 
by someone merely visiting a merchant review page and anonymously entering a 
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review, may be presented lower on the list of reviews. In one embodiment, reviews 
from verified purchasers are first presented, and a user can then activate a link to cause 
reviews from other reviewers to be presented. 

Figure 5 illustrates the basic hardware and software components that are typically 
5 invoked during the above-described process. As depicted by this drawing, customers 

access the Web site 550 using respective PCs 552, 554 or other general-purpose 
computers that have access to the Internet. The customers may alternatively access the 
Web site 550 using special purpose devices. The customer computers 552, 554 may ran 
commercially-available Web browser applications 562, 564 such as Microsoft Internet 

10 Explorer® or Netscape Navigator®, which implement the basic World Wide Web 

standards such as HTTP and HTML. 

The computers 552, 554 may also mn a commercially available e-mail application 
556, 566, such as Microsoft Outlook® or Netscape Navigator®, which may be used to 
receive communications from the merchant-related Web site 550. For example, the e-mail 

15 application 556, 566 may be used to receive review requests and send reviews, as 

previously described. The e-mail applications 556, 566 and the browsers 562, 564 may be 
integrated with one another, and/or may be integrated with other application programs or 
the operating system. 

In the embodiment described herein, the Web site 550 includes a computer system 

20 and associated content that are accessible via the Internet. The Web site 550 may 
optionally include content that spans multiple hitemet domains, and/or may be 
implemented using physical servers that are geographically remote from one another. In 
other embodiments, the Web site 550 may be in the form of an intranet site, in which case 
the computers 552, 554 may be coupled to the site solely by a private network. For 

25 example, Web site 550 may be in the form of an internal corporate store site for company 

employees. 

In other embodiments, the Web site 550 may be replaced with another type of 
network site. For example, the various services described herein could alternatively be 
implemented on a hypertextual site or browsing area of an online services network such as 
30 America Onhne® or MSN®, in which case users may access the site using software that 

implements non-standard document formats and transfer protocols. 
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As further depicted by Figure 5, the Web site 550 includes a commercially- 
available Web server application 570. The Web server apphcation 570 accesses an 
HTML and products database 576 that is used to generate Web pages in response to the 
actions of end users and which keeps track of product information and inventories. 
5 Various other back-end components (not shown) are also used for this purpose. 

The Web site 550 also includes a review request/collection apphcation 572 which 
includes the basic functionality for tracking when a review request should be provided to a 
customer and for offering incentives to customers provide reviews under certain 
circumstances. The review request/collection apphcation 572 accesses a review database 

10 578 and order history database 580 that store reviews and information (product codes, 

order dates, shipping dates, review incentive-types, review incentive periods, etc.) about 
when reminders or requests should be sent to customers, and optionally, what incentives 
or rewards will be offered to customers in exchange for reviews, hi one embodiment, all 
or part of the customer order history may be stored on the customer's computer system in 

15 cookies or the like in addition to or in place of being stored on the Web site 550 memory. 

The review request/collection application 572 may then access the customer cookie and 
using the order history stored there determine when reminders or requests should be sent 
to customers. To save storage space on the customer computer, only more recent orders, 
such as orders placed in the last 6 months, may be stored on the customer cookie. In 

20 addition, as reviews are received from the customer, the reviewed items' order information 

may be deleted fi:om the customer computer. 

The review request/collection application 572 may include an equation. The 
equation may be based on previous periods between orders and when reviews were 
received, and/or the number of holidays that have or will occur from the time the item 

25 was ordered. Thus, one embodiment of the present invention helps better estimate the 

time it will take for a purchaser to read a book or otherwise use a purchased item. Thus, 
the risk is reduced that the review request will be sent before a customer has had a 
chance to use the item or will be sent long after the customer has used the item. 

A recommendation application 582 is also coupled to the review database. The 

30 review application is used to generate personahzed recommendations for customers 

based on their reviews as well as on the reviews of others. In one embodiment, the 
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recommendation application utilizes a collaborative filtering algorithm, such as that 
described above, to generate the recommendations. 

Figure 6 illustrates an exemplary sequence of steps 600 that are performed by the 
review request/collection apphcation 572 to determine when to request a review. This 
5 process 600 executes after the customer has placed an order for an item, such as a book, 

video, CD, DVD, electronic equipment, car, clothing, and the hke. Beginning at state 602, 
the process 600 proceeds to state 604 where an order for an item is received from a 
customer. The process 600 dynamically determines or estimates the amount of time that 
will be needed by the customer to evaluate or at least initially evaluate the item. The 

10 customer evaluation may take the form of reading the item if the item is a book, viewing 
the item if the item is a video, driving the item if the item is a car or other vehicle, and so 
on. As previously discussed, if the item is a book the estimated time may vary based on 
the length and/or type of book. If the item is a video or audio recording, a review request 
may be provided after one week, as videos are often viewed and audio recording are 

15 listened to within a week of purchase or rental. Similarly, if the item is a can the 
estimated time may be related to the amount of time it will take the purchaser to drive a 
certain amount of miles, and so more thoroughly evaluate the car. For example, if the 
average person drives 10,000 miles a year, and a review is desired after the customer has 
driven and evaluated the car for 3,000 miles, a review request may be provided after 3.6 

20 months. Furthermore, as discussed above, other factors, such as holidays or vacations, 

may affect the estimate. Of course, other techniques may be used to generate the estimate. 

Once the estimate is performed, a corresponding date is stored in the database at 
state 608. The corresponding date may correspond exactly to the amount of time 
estimated to evaluate the item, or may instead fall a selected amount of time after or 

25 before such a date. For example, in order to increase the number of potential responses to 

review requests, the request may be provided a predetermined amount of time after the 
date that corresponds exactly to the amount of time estimated to evaluate the item, to 
thereby better ensure more customers have sufficient time to evaluate the item. 

A determination is made at state 610 as to whether the stored date has arrived 

30 and/or whether some other triggering event has occurred, such as the purchase of another 

similar item. If the stored date has arrived or some other triggering event has occurred, the 
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process 600 proceeds to state 612, and a review request is automatically generated and 
sent, or otherwise provided, to the customer. By way of example, the requests illustrated 
in Figures 1 and 4 may be used. Of course, as previously discussed, if the item was sent 
as a gift, the review request may instead be presented to the gift recipient. At state 614, a 
5 determination is made as to whether a review has been received from the customer using, 

for example, the forms illustrated in Figures 2 and 3. If a review has been received, the 
process 600 proceeds to state 616, where the review is stored in the review collection 
database. Otherwise, the process 614 proceeds to the end state 622. 

Proceeding from state 616 to state 618, a determination is made as to whether the 

10 review meets certain criteria so as to be eligible for a reward. As discussed above, these 
criteria may include on or more of the following. The reward may only be provided if 
the customer responds within a certain period of time. The review may have to be 
greater than a first number of words and/or less than a second number of words. In 
addition, the inclusion of obscenities or other offensive language may make the review 

15 ineUgible for a reward. The reviews of only selected items may be eligible for a reward. 

If the review is eligible for a reward, the process 600 proceeds to state 620, where the 
reward is provided. Otherwise, the process proceeds to state 622, where the process 600 
ends. 

Thus, as discussed above, in one embodiment, the present invention 
20 advantageously increases the number of reviews provided by customers by sending out 

review requests after enough time has elapsed so that it is likely that the customer has 
evaluated the item. In addition, customers may optionally be offered rewards in 
exchange for reviews, thereby further increasing the number of customer reviews. 

Although this invention has been described in terms of certain preferred 
25 embodiments, other embodiments that are apparent to those of ordinary skill in the art are 

also within the scope of this invention. Accordingly, the scope of the present invention is 
intended to be defined only by reference to the appended claims. 
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WHAT IS CLAIMED IS : 

1 . A method of encouraging customers to provide reviews of purchased items, 
the method comprising: 

receiving a customer order for an item purchased from an electronic 
5 catalog; 

estimating by what date the customer will have at least initially evaluated 
the item; 

electronically transmitting to the customer on or after the estimated date 
a message requesting the customer to provide a review of the item; 
10 receiving the customer review electronically; and 

presenting the review to another customer interested in the item. 

2. The method as defined in Claim 1, wherein the review is a numerical rating. 

3. The method as defined in Claim 1, wherein the review includes at least one 
of a textual review and a numerical rating. 

15 4. The method as defined in Claim 1, fiirther comprising verifying that the 

review is from a purchaser of the reviewed item, and in conjunction with presenting the 
review, to other customers, indicating that the review comes from a purchaser of the 
reviewed item. 

5. The method as defined in Claim 1, fiirther comprising offering the customer 
20 a reward in exchange for the customer providing a review. 

6. The method as defined in Claim 1, wherein the review request is provided 
via e-mail. 

7. The method as defined in Claim 1, wherein the review request is presented 
on a Web page. 

25 8. The method as defined in Claim 1, wherein the customer accesses a review 

form using the review request message. 

9. The method as defined in Claim 1, wherein the review request includes a 
hyperlink to a review form. 

10. The method as defined in Claim 1, further comprising using a collaborative 
30 filter which, based at least in part on the customer's review, provides the customer 

personahzed recommendations for items similar to the reviewed item. 
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11. The method as defined in Claim 1, further comprising requesting the 
customer to review a seller of the purchased item on or after the estimated date. 

12. The method as defined in Claim 1, further comprising: 

receiving at least one e-mail address provided by the customer; and 
5 forwarding the customer review to the e-mail address. 

13. The method as defined in Claim 1, wherein the item is a book and the 
estimated time period is based at least in part on the length of the book. 

14. A method of obtaining an item review firom a user and providing the user 
item recommendations, the method comprising: 

10 prompting the user to assign a score to an item a selected time period 

after the user has acquired the item; 

including the score in a profile for the user; and 

using the profile, including the score, to generate personalized 
recommendations for the user. 
15 15. The method as defined in Claim 14, further comprising using a collaborative 

filter to generate the personahzed recommendations. 

16. The method as defined in Claim 14, wherein the prompt includes a request 
for a textual review. 

17. The method as defined in Claim 14, wherein the score is used to provide 
20 personalized recommendations to other users, 

18. A method of requesting a review of a purchased item, the method 
comprising: 

receiving a customer order for an item purchased from an electronic 
catalog; 

25 inferring when the customer has evaluated the item; 

providing a review request in response to at least the inference, wherein 
the review request requests that the customer provide a review of the purchased 
item; and 

receiving the review electronically, 
30 19. The method as defined in Claim 18, further comprising verifying that the 

received review is fi-om a customer that ordered the item. 
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20. The method as defined in Claim 18, presenting the received review to other 
customers in conjunction with an indication that the review is from a purchaser of the 
item. 

5 21 . The method as defined in Claim 1 8, where the received review is provided to 

other customers. 

22. The method as defined in Claim 18, where the received review is used to 
recommend other items to the customer. 

23. The method as defined in Claim 18, where the received review is used to 
1 0 recommend the item to other customers. 

24. The method as defined in Claim 18, where the inference is based at least on 
an estimation of how long it will take to evaluate the purchased item. 

25. The method as defined in Claim 18 where the review request is selectively 
delivered on one of a weekend and a hoHday. 

15 26. The method as defined in Claim 18, where the inference based at least on a 

consumer survey on how long it takes consumers to read books, 

27. The method as defined in Claim 18, where the inference is based at least in 
part on the customer ordering a new item. 

28. The method as defined in Claim 18, further comprising presenting to the 
20 customer a list of items purchased by the customer to the customer and asking the 

customer if the customer wants to review one or more of the Usted items. 

29. The method as defined in Claim 18, further comprising offering the customer 
an incentive to provide the item review. 

30. The method as defined in Claim 18, where the item is a car and the estimated 
25 time period is related to the estimated time it will take the customer to drive a first 

amoimt. 

31. The method as defined in Claim 18, where the item is a video and the 
estimated time period is related to the estimated time until the customer has viewed the 
video. 
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32. The method as defined in Claim 18, where the item is an audio recording and 
the estimated time period is related to the estimated time until the customer has listened 
to the audio recording. 

33. The method as defined in Claim 18, where the item is a book and the 
5 estimated time period is related to the type of book. 

34. The method as defined in Claim 18, where the item is a gift for a recipient 
and the review request is provided to the recipient. 

35. The method as defined in Claim 18, where the review includes at least one of 
a rating and a textual review. 

10 36. A method of requesting a review of a purchased item, the method 

comprising: 

receiving a customer order for an item purchased from an electronic 
catalog; 

selecting a time to request a review of the purchased item, where the time 
15 is selected at least in part on an estimated evaluation period; and 

providing an item review request, wherein the timing of the request is 
based at least in part on the selected time. 

37. The method as defined in Claim 36, further comprising providing the 
customer a request to review an item seller associated with the electronic catalog, 

20 wherein the timing of the request is based at least is part on the selected time. 

38. The method as defined in Claim 36, wherein the review request is provided 
via e-mail.The method as defined in Claim 36, wherein the review request is presented 
on a Web page. 

39. The method as defined in Claim 36, where the review is used to generate a 
25 customer profile. 

40. The method as defined in Claim 36, where the evaluation period varies from 
a first item to a second item. 

41. A method of presenting item reviews, comprising: 

receiving a plurality of reviews; 
30 identifying which reviews are from purchasers of the reviewed item; and 
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presenting at least a portion of the plurality of reviews, wherein the 
reviews from purchasers of the reviewed item are emphasized. 
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METHODS AND SYSTEMS OF OBTAINING CONSUMER REVIEWS 

Abstract of the Disclosure 
One embodiment of the present invention is a system and method of 
encouraging customers to review purchased items. Customers are provided with review 
requests a predetermined amount of time after the customer has purchased an item or 
had the item delivered. The predetermined amount of time is related to an estimated 
time it will take the customer to evaluate the item. The reviews may include textual 
reviews that are presented to other customers and/or item ratings that are used to 
generate personal recommendations. 
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